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SUMMARY 


Problem 

The  Basic  Journalist  (JO)  Class  "A"  school,  a  Joint-services  Department  of 
Defense  training  course,  has  experienced  substantial  attrition  in  recent  years. 
The  attrition  rate  for  Navy  personnel  has  exceeded  15  percent  every  year  since 
1979.  Concern  over  this  high  attrition  rate  led  the  Navy  Personnel  Research  and 
Development  Center  to  examine  the  validity  of  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  composite  that  is  used  to  determine  eligibility  for 
school  assignment,  as  well  as  the  validity  of  the  English  Diagnostic  Test  (EDT), 
which  is  used  by  the  school  to  identify  students  requiring  remedial  English 
training. 

Objective 


The  first  objective  of  this  study  was  to  evaluate  the  clerical  composite, 
which  is  the  ASVAB  composite  used  by  the  Navy  to  select  students  for  JO  school, 
in  comparison  to  the  general  technical  composite  and  other  alternate  ASVAB  com¬ 
posites.  The  second  objective  was  to  evaluate  the  contribution  of  the  EDT  to 
the  validity  of  the  clerical  and  general  technical  selector  composites. 

Approach 

The  sample  consisted  of  179  Navy  enlisted  personnel  who  enrolled  in  JO  "A" 
school  between  October  1980  and  December  1983,  and  who  had  been  tested  on  ASVAB 
Forms  8,  9,  or  10.  The  predictor  variables  were  the  10  ASVAB  tests  and  the 
verbal  measure  of  ASVAB  (VE) ,  the  11  ASVAB  composites  in  use  by  the  Navy,  25  ex¬ 
perimental  composites,  and  the  EDT.  Criterion  measures  were  final  school  grade 
(FSG),  class  standing  (CLSTAND) ,  and  final  status  (GRAD/DROP)  in  the  JO  course. 

Means  and  standard  deviations  of  the  three  school  performance  criteria  were 
computed  for  (a)  the  total  sample,  (b)  students  who  passed  the  EDT,  (c)  students 
who  failed  the  EDT,  (d)  males,  and  (e)  females. 

Correlations  were  computed  between  the  predictors  and  the  criteria  and  then 
corrected  for  range  restriction.  Multiple  correlations  were  computed  between 
each  criterion  measure  and  (a)  the  ASVAB  JO  selector  composites  used  by  each  of 
the  military  services,  coupled  with  the  EDT,  and  (b)  the  general  technical  com¬ 
posite  coupled  with  individual  ASVAB  tests.  Expectancy  tables  were  constructed 
for  the  clerical  and  the  general  technical  composites,  using  GRAD/DROP  as  the 
criterion. 
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Results 


The  general  technical  composite  predicted  all  three  criterion  measures 
better  than  the  clerical  composite,  with  significant  differences  for  FSG  and 
GRAD/DROP.  The  uncorrected  correlations  of  the  general  technical  composite  with 
FSG,  CLSTAND,  and  GRAD/DROP  were  .43,  -.42,  and  .45  respectively;  the  corre¬ 
sponding  values  for  the  clerical  composite  were  .26,  -.30,  and  .26. 

For  all  criteria,  the  EDT  substantially  increased  validity  when  combined 
with  the  clerical  or  the  skilled  technical  composites.  The  EDT  did  not, 
however,  contribute  significantly  to  the  validity  of  the  general  technical  com¬ 
posite  for  predicting  CLSTAND,  and  it  made  only  small  additions  to  the  validity 
for  predicting  FSG  and  GRAD/DROP.  The  multiple  correlations  before  and  after 
EDT  was  added  were  .46  and  .51  for  FSG  and  .48  and  .52  for  GRAD/DROP.  Although 
these  increases  in  explained  variance  were  statistically  significant,  their 
practical  significance  is  doubtful. 

Conclusions 


1.  The  ASVAB  general  technical  composite  is  more  valid  for  predicting  the 
performance  of  Navy  students  in  JO  school  than  is  the  currently  used  ASVAB  cler¬ 
ical  composite. 

2.  None  of  the  other  ASVAB  composites  is  significantly  more  valid  than  the 
general  technical  composite  for  predicting  JO  school  performance. 

3.  The  EDT  makes  a  small  but  practically  insignificant  contribution  to  the 
validity  of  the  general  technical  composite. 

Recommendations 


1.  The  ASVAB  general  technical  composite,  rather  than  the  currently  used 
clerical  composite,  should  be  adopted  to  select  Navy  students  for  JO  school. 

2.  The  EDT  should  not  be  added  to  the  Navy  JO  school  selection  criteria. 
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INTRODUCTION 


Problem 


Attrition  in  the  Basic  Journalist  (JO)  Class  "A”  school,  a  Joint-services 
Department  of  Dsfsnsa  training  courts,  has  bssn  substantial  in  rscsnt  yssrs. 
Acsdsmic  attrition  of  Navy  parsonnal  has  consistently  exceeded  15  percent--the 
•stablishsd  management  attrition  limit--from  1979  to  the  present.  This  high 
attrition  has  occurred  even  though  all  JO  students  are  required  to  take  a  test 
of  basic  English  skills,  the  English  Diagnostic  Test  (EDT) ,  upon  arrival  at  the 
school,  and  those  who  fail  are  required  to  complete  a  3-week  refresher  English 
course  before  beginning  regular  JO  training. 

Background 

The  measure  used  to  select  enlistees  for  JO  training  is  derived  from  the 
Armed  Services  Vocational  Aptitude  Battery  (ASVAB),  the  instrument  used  by  the 
military  services  to  select  and  classify  enlisted  personnel.  The  operational 
version  of  the  ASVAB,  Forms  8,  9,  and  10,  consists  of  10  cognitive  tests  (de¬ 
scribed  in.Table  1)  and  a  verbal  measure  (VE),  the  sum  of  the  word  knowledge  and 
paragraph  comprehension  tests.  Several  ASVAB  composites --combinations  of  cer¬ 
tain  ASVAB  tests-- are  used  by  the  military  to  determine  eligibility  for 
assignment  to  specific  technical  schools  or  to  on-the-job  training. 

The  ASVAB  8,  9,  and  10  selector  composite  that  is  currently  used  by  the  Na¬ 
vy  to  determine  qualification  for  the  JO  school  is  the  clerical  composite 
(CLER);  it  consists  of  the  sum  of  the  verbal  measure  (VE),  the  numerical  oper¬ 
ations  test  (NO),  and  the  coding  speed  test  (CS)  (VE  +  NO  +  CS).  In  contrast, 
the  Air  Force  and  the  Marine  Corps  use  a  selector  composite  that  the  Navy  calls 
the  general  technical  composite  (GT).  It  consists  of  VE  and  the  arithmetic  rea¬ 
soning  test  (AR)  (VE  +  AR).  The  Army  uses  the  skilled  technical  composite  (ST), 
a  composite  that  is  not  part  of  the  Navy  personnel  selection  system;  it  consists 
of  VE  combined  with  the  general  science  (GS) ,  mathematics  knowledge  (MK) ,  and 
mechanical  comprehension  tests  (MC)  (VE  +  MK  +  MC  +  GS) .  Table  2  presents  the 
ASVAB  composites  used  by  each  of  the  military  services  to  select  students  for  JO 
"A"  school. 

Concern  over  the  high  attrition  of  JO  "A"  school  students  led  Parks, 
Mathews,  and  Ree  (1983)  to  investigate  the  predictive  validity  of  the  ASVAB  8, 

9,  and  10  composites  used  for  selecting  JO  students,  and  to  assess  the  contrib¬ 
ution  of  the  EDT  to  the  validity  of  the  ASVAB  JO  selector  composites.  For  their 
sample  of  personnel  from  all  services  combined,  (N  ■  228),  Parks  et  al.  (1983) 
found  the  GT  composite  to  be  substantially  more  predictive  of  final  grades  in  JO 
school  than  either  the  CLER  or  the  ST  composite.  Interestingly,  they  found  that 
the  EDT  significantly  increases  the  validity  achieved  by  either  the  CLER  or  the 
ST  composite  alone,  but  does  not  significantly  increase  that  of  the  GT 
composite.  Furthermore,  their  results  showed  that  the  GT,  by  itself,  predicts 
JO  school  performance  better  than  either  the  EDT  and  the  CLER  combined,  or  the 
EDT  and  the  ST  composite  combined.  The  results  for  the  Navy  students  only  (N  * 
48)  were  the  same,  except  that  the  GT  composite  predicted  school  performance  on- 
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ly  slightly  bsttsr  than  did  ths  CLER  and  ST  coopositas.  In  addition,  for  this 
sampla  tha  IDT  was  found  to  oaks  a  significant  contribution  to  tha  validity  of 
tha  GT  cooposita.  Basad  on  thair  findings,  Parks  at  al.  (1983)  rscoonandad  that 
tha  GT  cooposita  ba  uaad  by  all  of  tha  military  sarvicas  to  salact  studants  for 
JO  "A"  school. 


Oblactiva 

Tha  first  objactiva  of  this  study  was  to  avaluata  tha  CLER  cooposita,  usad 
by  tha  Navy  to  salact  studants  for  JO  school,  in  cooparison  to  tha  GT  cooposita 
and  othar  altarnata  ASVAB  coopositas.  Tha  sacond  objactiva  was  to  avaluata  tha 
contribution  of  tha  EDT  to  tha  validity  of  tha  CLER  and  GT  salactor  coopositas. 


TabU  1 


Predictor  Variables  from  ASVAB  Font  8,  9,  end  10 


Predictor 

Variable 

Abbreviation 

Description 

ASVAB  Tests* 

General  science 

GS 

A  25-item  test  of  knowledge  of  the 
physical  (13  items)  and  biological 
(12  items)  aciences--ll  minutes. 

Arithmetic  reasoning 

AR 

A  30-item  test  of  ability  to  solve 
arithmetic  word  problems--36 
minutes . 

Word  knowledge 

WK 

A  35 -item  test  of  knowledge  of 
vocabulary ,  using  words  embedded 
in  sentences  (11  items)  and 
synonyms  (24  items)-- 11  minutes. 

Paragraph  comprehension 

PC 

A  15-item  test  of  reading  compre¬ 
hension-  -13  minutes. 

Numerical  operations 

NO 

A  50-item  speeded  test  of  ability 
to  add.  subtract,  multiply,  and 
divide  one-digit  and  two-digit 
numbers --3  minutes. 

Coding  speed 

CS 

An  84 -item  speeded  test  of  ability 
to  recognise  numbers  associated 
with  words  from  a  table--7 
minutes . 

Auto  and  shop  information 

AS 

A  25 -item  test  of  knowledge  of 
automobiles,  shop  practices,  and 
use  of  tools--ll  minutes. 

Mathematics  knowledge 

MK 

A  25 -item  test  of  knowledge  of 
algebra,  geometry,  fractions, 
decimals,  and  exponents--24 
minutes . 

*Reported  as  Navy  Standard  Scores  having  a  mean  of  about  50  and  a  standard  devi¬ 
ation  of  10  for  an  unrestricted  recruit  population. 


3 


Table  1  (Continued) 


Predictor 

Variable 

Abbreviation 

Description 

Mechanical  comprehension 

MC 

A  25-item  test  of  knowledge  of 
mechanical  and  physical  principles 
-•19  minutes. 

Electronics  information 

El 

A  20-item  test  of  knowledge  of 
electronics,  radio,  and  electrical 
principles  and  information--) 
minutes . 

Verbal 

VE 

A  composite  consisting 
of  VK  +  PC. 

ASVAB  Selector  Composites  Used  by  Military  Services 


All  Services 

AR+N0/2+VE 

AFQT 

Armed  Forces  Qualification  Test 

VE+AR 

GT 

General  Technical 

AR+MK+EI+GS 

ELEC 

Electronics 

VE+NO+CS 

CLER/A 

Clerical  (U6ed  as  Administrative 

VE+MC+AS 

MECH 

Composite  (A)  by  Air  Force) 

Mechanical 

VE+MC 

AM 

Selector  for  Aviation  Structural 

AR+2MK+GS 

BE/Eb 

Mechanic  School 

Selector  for  Basic  Electricity 

MK+AS 

BT/EN/MM 

and  Electronics  School 

Selector  for  Boiler  Technician, 

VE+AR+NO+CS 

CT 

Engineman,  and  Machinist's 

Mate  Schools 

Selector  for  Communications 

VE+MK+GS 

HM 

Technician  (Interpreter)  School 
Selector  for  Hospitalman  School 

bNot  all  BE/E  schools  use  the  "BE/E"  composite  as  the  operational  selector,  nor 
is  this  selector  used  only  by  BE/E  schools--a  number  of  "A"  schools  use  it  as 
well. 


Table  1  (Continued) 


Predictor 

Variable 

Abbreviation 

Description 

ASVAB 

Selector  Composites  Used  by  Military  Services  (Continued) 

AR+MC+AS 

MR 

Selector  for  Machinery 

VE+AR+MC 

SUB 

Repairman  School 

Selector  for  Submarine  School 

MK+EI+GS 

ELEC  Compc 

Component  of  Electronics 

Air  Force 

MC+GS+2AS 

M 

Mechanical 

Army 

CS+AR+MC+AS 

CO 

Combat 

CS+AR+MC+MK 

FA 

Field  Artillery 

NO+VE+MC+AS 

OF 

Operators  and  Food 

NO+CS+VE+AS 

SC 

Surveillance  and  Communications 

MK+EI+GS+AS 

GM 

General  Maintenance 

NO+EI+MC+AS 

MM 

Mechanical  Maintenance 

VE+MK+MC+GS 

ST 

Skilled  Technical 

Experimental  ASVAB  Composites 


NO+VE+AS 

AR+VE+AS 

VK+AR 

WK+MC+AS 

WK+NO+CS 

AR+MC 

CS+VE+AR 

MK+EI+AS 

AR+MK+MC 


AR+EI+MC 

VE+MK 

MK+EI 

MK+MC+EI 

AR+MK 

AR+EI+GS 

AR+MK+AS 

MC+MK+AS 


c 

Most  of  the  Navy  schools  that  use  the  electronics  composite  use  the  following 
dual  cutoffs:  MK  +  EX  +  GS  =  156  +AR  =  218.  MK  +  El  +  GS  is  never  used  by  itself 
as  a  school  selector. 


Table  2 


ASVAB  6,  9,  and  10  Composites  Used  by  the  Military  Services 
For  Selecting  JO  School  Students 


Service 

Composite 

Tests  Included 

Navy 

Clerical  (CLER) 

VE  +  NO  +  CS 

Air  Force 

General  technical  (GT) 

VE  +  AR 

Marine  Corps 

General  technical  (GT) 

VE  +  AR 

Army 

Skilled  technical  (ST) 

VE  +  MK  +  MC  +  GS 

APPROACH 


Sample 

The  original  sample  consisted  of  187  Navy  enlisted  personnel  who  were  en¬ 
rolled  in  JO  "A"  school  between  October  1980  and  December  1983,  and  who  .had  been 
tested  on  ASVAB  Forms  8,  9,  or  10.  Data  for  eight  subjects  who  were  dropped  from 
the  course  for  nonacademic  causes  (e.g. ,  medical  problems),  which  ASVAB  tests 
are  not  intended  to  predict,  were  deleted  from  the  sample.  The  resulting  sample 
consisted  of  179  students,  but  sample  sires  for  t  x&e  analyses  were  smaller  be¬ 
cause  of  missing  data  on  particular  variables. 

Predictors 


The  predictor  variables  were  the  10  ASVAB  8,  9,  and  10  tests,  the  ASVAB 
verbal  measure  (VE),  the  11  ASVAB  composites  currently  used  by  the  Navy,  and  25 
experimental  composites  (see  Table  1).  In  addition,  the  EDT,  a  64-item 
paper-and-pencil  instrument  designed  to  assess  basic  English  skills,  served  as  a 
predictor . 

Criteria 

Criteria  of  JO  "A"  school  performance  were: 

1.  Final  school  grade  (FSG):  The  average  of  scores  obtained  by  the  stu¬ 
dent  on  all  class-administered  tests. 

2.  Class  standing  (CLSTAND) :  The  student's  ranking,  as  determined  by  FSG, 
in  relation  to  his  or  her  class. 

3.  Final  status  (GRAD/DROP):  A  designation  of  whether  the  student  gradu¬ 
ated  or  dropped  from  the  course  due  to  academic  difficulties.  Drops  were  coded 
1;  graduates  were  coded  2.  FSG  and  CLSTAND  were  not  available  for  students  who 
dropped  the  course. 

Data  Analyses 

Descriptive  Statistics 

Means  and  standard  deviations  of  the  three  school  performance  criterion 
variables  were  computed  for  (a)  the  total  sample,  (b)  students  who  passed  the 
EDT  (scored  40  or  above),  (c)  students  who  failed  the  EDT  (scored  less  than  40), 
(d)  males,  and  (e)  females.  These  calculations  were  performed  separately  so 
that  any  potentially  relevant  school  performance  differences  could  be  detected. 


Bivariate  Correlations 


Pearson  product  -moment  correlations  of  the  ASVAB  variables  (tests  and  com¬ 
posites)  and  the  EDT  were  computed  with  FSG,  CLSTAND,  and  GRAD/DROP,  so  that  the 
validity  of  alternate  ASVAB  measures  and  the  EOT  could  be  compared  with  that  of 
the  current  Navy  JO  selector,  the  CLER  composite.  The  differences  between  these 
correlations  were  tested  for  significance  (Cohen  &  Cohen,  1975,  p.  53).  The 
correlation  coefficients  were  then  corrected  for  restriction  in  range,  to  re¬ 
flect  the  values  that  would  be  obtained  for  a  sample  representing  the  full  range 
of  ability  of  Navy  recruits.  The  corrections  were  made  using  Lawley's  technique 
(1943),  which  adjusts  for  range  restriction  resulting  from  multivariate  se¬ 
lection.  The  population  statistics  used  for  the  corrections  were  based  on  a 
group  of  66,459  recruits  who  entered  the  Navy  from  July  1981  though  May  1982. 

Multiple  Correlations 

Multiple  correlation  coefficients  (Rs)  were  calculated  using  a  forward  hi¬ 
erarchical  procedure,  with  the  ASVAB  selector  composite  of  interest  (e.g.,  the 
CI£R  composite)  entered  into  the  equation  first,  followed  by  the  EDT.  This  pro¬ 
cedure  was  repeated  with  each  of  the  three  criteria  serving  as  dependent  vari¬ 
ables,  and  for  each  of  the  service's  JO  selector  composites --the  CLER,  GT,  and 
ST  composites.  These  analyses  were  performed  to  determine  whether  the  EDT  makes 
a  significant  contribution  to  the  predictive  ability  of  the  ASVAB  JO  selector 
composites . 

Multiple  correlations  were  also  performed  using  a  standard  stepwise  re¬ 
gression  procedure  (forward  selection),  in  which  the  GT  composite  and  the  indi¬ 
vidual  ASVAB  tests  were  entered  as  predictors.  (The  VE  score  was  used  instead 
of  the  WK  and  PC  scores  separately.)  These  analyses  were  performed  to  determine 
whether  any  of  the  ASVAB  tests  not  already  included  in  the  GT  composite  add 
signficantly  to  its  predictive  ability. 

Expectancy  Analyses 

Expectancy  tables  were  constructed  for  the  current  and  proposed  Navy  JO  se¬ 
lectors — the  CLER  and  the  GT  composites --using  GRAD/DROP  as  the  criterion.  The 
population  values  used  for  the  analysis  were  based  on  the  sample  of  66,459  re¬ 
cruits  that  was  used  for  correcting  validity  coefficients  for  range  restriction. 


RESULTS 


Descriptive  Statistics 

The  means  and  standard  deviationa  of  the  three  school  performance  criteria, 
FSG,  CLSTAND,  and  GRAD/DROP,  are  presented  in  Table  3.1  These  statistics  are 
shown  for  (a)  all  students,  (b)  students  who  passed  the  EDT,  (c)  students  who 
failed  the  EDT,  (d)  males,  and  (e)  females.  As  shown,  the  school  performance  of 
students  who  passed  the  EDT  tended  to  be  better  than  that  of  those  who  failed, 
suggesting  that  the  EDT  has  some  validity  for  predicting  JO  training 
performance.  An  inspection  of  the  mean  criterion  scores  computed  for  male  and 
female  students  separately  revealed  only  trivial  performance  differences. 

Bivariate  Correlations 

Pearson  product -moment  correlations  of  the  ASVAB  predictors  and  EDT  with 
FSG,  CLSTAND,  AND  GRAD/DROP  are  presented  in  Table  4.  Uncorrected  correlations 
that  were  found  to  be  significantly  higher  than  those  obtained  for  the  opera¬ 
tional  CLER  selector  composite  are  marked  in  the  table  with  asterisks.  Some 
correlations  marked  with  asterisks  are  lower  than  some  unmarked  correlations  be¬ 
cause  the  significance  test  takes  into  consideration  the  intercorrelations  of 
the  predictors  being  compared  and  not  just  the  differences  between  the  uncor¬ 
rected  correlation  coefficients. 

For  all  three  measures  of  school  performance,  the  general  technical  compos¬ 
ite  was  found  to  be  more  valid  than  the  clerical  composite.  The  corrected  cor¬ 
relations  of  the  general  technical  composite  with  FSG,  CLSTAND,  and  GRAD/DROP 
are  .52,  -.55,  and  .54  respectively;  the  corresponding  values  for  the  clerical 
composite  are  .41,  -.51,  and  .39.  (Negative  correlations  were  expected  for  the 
CLSTAND  criterion,  since  high  ability  students  were  expected  to  achieve  numer¬ 
ically  lower  class  standing  scores;  for  example,  the  top  student  in  the  class 
would  receive  a  CLSTAND  score  of  1.)  These  differences  are  significant  for  FSG 
and  for  GRAD/DROP  (p  <  .05),  but  not  for  CLSTAND. 

Only  one  other  ASVAB  composite,  WK  +  AR,  appeared  to  predict  all  three 
school  performance  measures  as  well  or  better  than  the  GT  composite.  However, 
the  differences  were  not  significant. 

Table  4  clearly  indicates  that  for  all  three  criterion  measures,  the  EDT  is 
more  valid  than  the  CLER  composite.  These  differences  were  statistically  sig¬ 
nificant  for  FSG  and  for  GRAD/DROP  but  not  for  CLSTAND.  For  both  FSG  and 
GRAD/DROP,  the  EDT  is  also  more  valid  than  the  majority  of  the  ASVAB  predictors. 

It  is  also  apparent  from  Table  4  that  the  EDT  predicts  FSG  and  GRAD/DROP 
about  as  well  as  the  GT  composite.  Although  the  GT  composite  appeared  slightly 
more  valid  then  the  EDT  for  predicting  CLSTAND,  this  difference  was  not  signif- 


lAll  tables  referred  to  in  Results  may  be  found  at  the  end  of  the  section,  start' 
ing  on  page  11. 


leant.  The  corrected  correlations  of  the  EDT  with  FSG,  CLSTAND,  and  GRAD/DROP 
are  .53,  -.47,  and  .51  respectively;  the  corrected  correlations  of  the  general 
technical  composite  are  .52,  -.55,  and  .54. 

Multiple  Correlations 

The  results  of  the  hierarchical  multiple  regression,  in  which  the  ASVAB  JO 
school  selector  composite  was  entered  into  the  equation  first,  followed  by  the 
EDT,  are  shown  in  Table  5.  For  each  of  the  three  criteria,  the  GT  composite  com¬ 
bined  with  the  EDT  resulted  in  a  higher  multiple  correlation  coefficient  than 
any  of  the  other  measures  or  combinations  of  measures  used.  For  both  the  FSG  and 
GRAD/DROP  criteria,  EDT  significantly  increased  the  multiple  correlation  coef¬ 
ficient  when  combined  with  any  of  the  three  JO  school  selectors  used  by  the 
services.  For  the  CLSTAND  criterion,  however,  the  EDT  made  a  significant  con¬ 
tribution  to  the  multiple  correlation  coefficient  when  combined  with  either  the 
CLER  or  ST  composites,  but  not  when  combined  with  the  GT. 

For  each  of  the  three  criterion  measures,  the  predictive  validity  of  the  GT 
composite  alone  is  about  the  same  as  that  of  the  CLER  composite  and  the  EDT  com¬ 
bined,  or  of  the  ST  composite  and  the  EDT  combined.  The  multiple  correlation 
coefficients  for  predicting  FSG,  CLSTAND,  and  GRAD/ DROP  are  .46,  .42,  and  .48 
respectively  for  the  GT  composite  alone,  .47,  .43,  and  .48  for  the  CLER  compos¬ 
ite  and  the  EDT  combined,  and  .49,  .42,  and  .49  for  the  ST  composite  and  the  EDT 
combined . 


Table  6  shows  the  results  of  the  stepwise  multiple  regression  analyses, 
with  the  GT  composite  and  the  ASVAB  tests  entered  as  predictors  and  with  each  of 
the  three  school  performance  measures  serving  as  dependent  variables .  For  both 
FSG  and  CLSTAND,  the  electronics  information  (El)  and  numerical  operations  (NO) 
tests  significantly  increased  the  multiple  correlation  coefficients  over  the 
value  obtained  with  only  the  GT  composite  in  the  equation.  For  the  GRAD/DROP 
criterion,  two  different  ASVAB  tests--mechanical  comprehension  (MC)  and  general 
science  (GS) --significantly  increased  the  multiple  correlation  over  that  ob¬ 
tained  for  the  GT  composite  alone. 

Although  the  addition  of  the  individual  ASVAB  tests  to  the  regression 
equations  increased  the  multiple  correlation  coefficients  to  a  statistically 
significant  extent,  the  increases  were  actually  quite  modest.  This  was  partic¬ 
ularly  true  for  the  GRAD/DROP  measure,  for  which  the  multiple  correlation  coef¬ 
ficient  increased  from  .45  to  .47  when  MC  was  added  to  the  GT  composite,  and  from 
.47  to  .49  when  GS  was  added  to  the  equation  containing  the  GT  composite  and  MC. 

Correlation  coefficients  of  five  ASVAil  composites  composed  of  the  tests  re¬ 
vealed  to  be  the  most  promising  by  the  multiple  regression  analyses  were  com¬ 
puted  with  the  three  school  performance  criteria;  they  are  presented  in  Table  7. 
These  correlations  were  computed  to  determine  whether  any  ASVAB  composites  pre¬ 
dicted  JO  training  performance  better  than  the  GT  composite. 

TVo  findings  of  interest  emerged  from  this  analysis.  First,  none  of  the 
promising  alternate  composites  is  significantly  more  valid  than  the  GT 
composite.  Second,  a  comparison  of  the  multiple  correlation  coefficients  in  Ta- 


ble  6  with  the  corresponding  simple  correlation* --those  obtained  for  the 
unit-weighted  compos  ite*  made  up  of  the  same  ASVAB  tests-- in  Table  7  showed  that 
for  FSG  and  for  CLSTAND,  the  unit-weighted  compos itea  are  Just  as  valid  as  the 
equations  using  exact  regression  weights.  This  was  not  the  case,  however,  for 
the  QUAD /drop  measure,  for  which  the  correlations  of  the  unit -weighted  compos¬ 
ites  VE  +  AR  +  MC  and  VE  +  AR  +  MC  +  OS  are  .36  and  .38,  respectively,  and  the 
corresponding  multiple  correlations  are  .47  and  .49.  But  even  if  a  simple  cor¬ 
relation  of  .49  had  been  found  for  the  unit-weighted  VE  +  AR  +  MC  +  GS  composite, 
it  would  still  not  have  been  significantly  greater  than  the  correlation  of  .45 
found  between  the  GT  composite  and  GRAD/DROP. 

Expectancy  Analyses 

Because  the  results  of  the  correlational  analyses  revealed  a  clear  tendency 
for  the  GT  composite  to  predict  performance  in  JO  "A"  school  better  than  the  op¬ 
erational  Navy  CLER  composite,  expectancy  tables  for  these  two  composites  were 
constructed;  they  are  shown  in  Table  8.  In  each  table,  data  are  presented  for 
the  current  cutting  score  (165),  or  for  the  corresponding  cutting  score  for  the 
proposed  composite  (112),  as  well  as  for  a  number  of  cutting  scores  above  and 
below  the  current  one.  The  tables  Bhow  the  number  of  recruits,  per  1000,  that 
would  be  expected  to  qualify  for  the  school,  and  the  number  of  graduates  and  ac¬ 
ademic  drops  expected  for  each  cutting  score. 

As  shown,  using  the  GT  composite  with  a  cutting  score  of  112  would  qualify 
about  the  same  number  of  recruits  (37%)  as  the  CLER  composite  does  (38%)  and 
would  result  in  36  more  graduates  and  46  fewer  drops  per  1000.  The  graduation 
rate  would  increase  from  77  to  89  percent;  conversely,  the  academic  attrition 
rate  would  decrease  from  23  to  11  percent. 

In  contrast,  if  the  ASVAB  clerical  composite  were  retained  with  the  current 
cutting  score  of  165,  to  obtain  an  academic  drop  rate  as  low  as  that  associated 
with  GT  =  112,  the  cutting  score  of  the  CLER  composite  would  have  to  be  raised  to 
180.  This  would  result  in  a  12  percent  academic  drop  rate,  but  it  would  also 
drastically  reduce  the  percentage  of  recruits  that  would  be  eligible  for  the 
school,  from  38  to  10  percent. 
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Table  3 


Means  and  Standard  Deviations  of  Research  Subjects 
By  School  Performance  Criterion 


FS6  CLSTAND  GRAD/DROP 

(N  «  138)  (N  *  137)  (N  »  179) 


Sample  Group 

Mean 

SD 

Mean 

SD 

Mean 

SD 

All  students 

82.09 

4.24 

14.88 

9.75 

1.77 

.43 

Students  who  passed  the  EDT 
(scored  40  or  greater) 

82.76 

4.08 

13.63 

9.64 

1.83 

.37 

Students  who  failed  the  EDT 
(scored  less  than  40) 

79.72 

2.10 

17.61 

7.54 

1.45 

.50 

Males 

82.03 

4.29 

14.85 

9.73 

1.75 

.43 

Females 

82.21 

4.19 

14.92 

9.90 

1.79 

.41 

Tab  l«i  A 


Correlations  of  EDT,  ASVAB  Testa,  and  ASVAB  Selector  Composites 
With  Three  School  Performance  Criteria 


Predictor 

FSG 

(N  «  138) 

Xu 

CLSTAND 
(N  «  137) 

ru  rc 

GRAD/DROP 
(N  -  179) 

ru  rc 

English  Diagnostic 

Test  (EDT) 

AS* 

53 

-36 

-47 

44* 

51 

ASVAB  Tests 

GS 

32 

41 

-31 

-41 

34 

43 

AR 

A3 

51 

-41 

-52 

37 

41 

VK 

30 

A3 

-28 

-41 

44* 

53 

PC 

20 

24 

-26 

-35 

35 

45 

NO 

18 

33 

-24 

-43 

00 

15 

cs 

03 

22 

-04 

-28 

07 

21 

AS 

25 

20 

-23 

-17 

22 

19 

MK 

37 

47 

-34 

-46 

40 

45 

MC 

33 

37 

-32 

-36 

15 

20 

El 

37 

41 

-38 

-39 

30 

44 

VE 

29 

37 

-30 

-42 

44* 

55 

Navy  Comoos ites  in  Use 

VE+AR  (GT) 

A3* 

52 

-42 

-55 

45* 

54 

VE+MC+AS 

35 

37 

-34 

-37 

28 

34 

AR+MK+EI+GS 

46* 

56 

-45 

-56 

43 

51 

VE+NO+CS  (CLER) 

26 

41 

-30 

-51 

28 

39 

VE+MC 

36 

AA 

-36 

-45 

29 

40 

AR+2MK+GS 

A3* 

54 

-40 

-54 

43 

50 

MK+AS 

37 

41 

-36 

-39 

36 

40 

VE+AR+NO+CS 

A0** 

50 

-42** 

-58 

39** 

45 

VE+MK+GS 

41 

50 

-39 

-52 

46* 

56 

AR+MC+AS 

40 

43 

-38 

-42 

29 

32 

VE+AR+MC 

A3 

52 

-42 

-53 

36 

45 

MK+EI+GS 

A3 

52 

-42 

-52 

41 

50 

Note.  Decimals  have  been  omitted.  Coefficients  marked  with  asterisks  are  sig¬ 
nificantly  higher  than  those  obtained  for  the  operational  JO  selector  composite 
(CLER):  *p  <  .05;  **p  <  .01. 
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Table  4  (Continued) 


FSG 

(N  -  138) 


CLSTAND 
(N  -  137) 


GRAD/OROP 
(N  -  179) 


Predictor 


Experimental  Composites 


MC+GS+2AS 

33 

34 

-32 

-32 

26 

29 

CS+AR+MC+AS 

41 

46 

-39 

-47 

31 

36 

CS+AR+MC+KK 

44* 

53 

-42 

-55 

36 

43 

NO+VE+MC+AS 

38 

46 

-39 

-49 

28 

37 

NO+CS+VE+AS 

34 

43 

-36 

-50 

33 

41 

MK+EI+GS+AS 

40 

47 

-39 

-45 

38 

45 

NO+EI+MC+AS 

39 

46 

-40 

-47 

25 

31 

VE+MK+MC+AS 

42 

51 

-40 

-51 

39 

49 

NO+VE+AS 

35 

44 

-37 

-49 

32 

41 

AR+VE+AS 

40 

45 

-39 

-45 

40 

46 

WK+AR 

44* 

55 

-42 

-55 

46* 

55 

WK+MC+AS 

35 

40 

-33 

-37 

29 

35 

VK+NO+CS 

26 

45 

-28 

-52 

28 

41 

AR+MC 

43 

51 

-42 

-50 

29 

35 

CS+VE+AR 

39* 

49 

-38 

-55 

43** 

51 

MK+EI+AS 

40 

45 

-38 

-43 

36 

41 

AR+MK+MC 

44 

53 

-42 

-53 

36 

42 

AR+EI+MC 

45* 

52 

-45 

-51 

32 

38 

VE+MK 

40 

49 

-37 

-51 

47* 

56 

rflC+EI 

44 

52 

-42 

-51 

41 

47 

MK+MC+EI 

43 

51 

-42 

-49 

34 

41 

AR+MK 

43 

53 

-41 

-53 

42 

47 

AR+EI+GS 

45* 

54 

-45 

-54 

41 

48 

AR+MK+AS 

42 

49 

-39 

-47 

39 

44 

MC+MK+AS 

38 

43 

-36 

-41 

30 

35 

Tab la  S 


Multipla  Corralations  of  Salactor  Compoaitas  and  tha  EDT 
With  Thraa  School  Parfornanca  Critaria 


FFG  CLSTAND  GRAD/DROP 

(N  -  114)  CN  -  113)  CN  «  154) 


Compos it a 

R 

R2 

2 

R  Chang* 

R 

R2 

R2  Chang* 

R 

R2 

2 

R  Chang* 

GT 

GT,  EDT 

.461 

.507 

.212 

.257 

.045* 

.422 

.443 

.178 

.196 

.018 

.482 

.518 

.233 

.269 

.036** 

CLER 

CLER,  EDT 

.234 

.466 

.055 

.217 

.162** 

.299 

.427 

.090 

.182 

.092** 

.299 

.478 

.089 

.229 

.140** 

ST 

ST,  EDT 

.401 

.487 

.161 

.237 

.076** 

.372 

.421 

.138 

.177 

.039* 

.423 

.488 

.179 

.238 

.059** 

Table  6 


Multiple  Correlation*  of  General  Technical  Composite  (GT) 
And  Moat  Valid  ASVAB  Teats  for  Predicting 
School  Performance  Criteria 


ASVAb 

Composite  or  Teat 

R 

R2 

R2  Change 

FSG 

(N  -  137) 

GT 

.432 

.166 

GT.EI 

.466 

.217 

.031* 

GT.EI.NO 

.489 

.239 

.022* 

CLSTAND  9 

(N  «  136) 


GT 

.424 

.180 

GT.NO 

.479 

.230 

.050** 

GT.N0.E1 

.S14 

.264 

.034* 

9 

GRAD/DROP 

CN  -  179) 

9 

GT 

.454 

.206 

GT.MC 

.473 

.224 

.018* 

GT.MC.GS 

.493 

.243 

.019* 

Table  7 


Correlations  of  Promising  Alternate  ASVAB  Composites 
With  School  Performance  Criteria 


FSG  CLSTAND  GRAD/DROP 


ASVAB  Composite 

(N  » 

ru 

138) 

r 

c 

(N  ■ 

ru 

137) 

rc 

(N  - 

ru 

179) 

rc 

GT  (VE+AR) 

43 

52 

-42 

-55 

45 

54 

VE+AR+EI 

47 

54 

-47 

-55 

44 

53 

VE+AR+EI+NO 

49 

58 

-51 

-64 

42 

51 

VE+AR+NO 

46 

55 

-48 

-62 

41 

48 

VE+AR+MC 

43 

52 

-42 

-53 

36 

45 

VE+AR+NC+GS 

43 

52 

-43 

-53 

38 

47 

Note.  Decimals  have  been  omitted. 
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Tabla  a 


Expectancy  Analysis  for  Clarical  (CLER)  and  Ganaral  Technical  (QT)  Coapositea 
(N  ■  137  graduates,  A2  acadanic  drops,  179  total) 


At  or 

Abova  Cut 

Expectancies  Par  1000 
in  Population 

Salactor 

Cutting 

Scora 

Acad 
Grad  Drop 

N  N 

Total  Grad 
N  X 

Acad 

Drop 

X 

Scora  in 
Raeruit 
Population 
X 

Acad 

Total  Grad  Drop 

Oparational  Salactor:  CLER 


160 

136 

40 

176 

77 

23 

49 

490 

377 

113 

165* 

134 

39 

173 

77 

23 

38 

380 

293 

87 

170 

121 

26 

147 

82 

18 

27 

270 

221 

49 

175 

93 

20 

113 

82 

18 

18 

180 

148 

32 

180 

57 

8 

65 

88 

12 

10 

100 

88 

12 

185 

29 

2 

31 

94 

6 

5 

50 

47 

3 

190 

16 

1 

17 

94 

6 

2 

20 

19 

1 

Proposad  Salactor:  GT 


107 

118 

17 

135 

87 

13 

50 

500 

435 

65 

112* 

12 

113 

89 

11 

37 

370 

329 

41 

116 

85 

6 

91 

93 

7 

27 

270 

251 

19 

120 

68 

3 

71 

96 

4 

17 

170 

163 

7 

123 

49 

2 

51 

96 

4 

11 

110 

4 

126 

29 

2 

31 

94 

6 

6 

60 

56 

4 

129 

15 

1 

16 

94 

6 

2 

20 

19 

1 

aOparstional  (CLER)  or  proposad  (GT)  cutting  score. 


DISCUSSION  AND  CONCLUSIONS 


In  general,  the  results  of  this  research  were  consistent  with  those  ob¬ 
tained  by  Parks  et  al.  (1963),  and  essentially  constitute  a  cross-validation  of 
their  findings.  The  present  results  show  that  the  GT  composite,  which  has  been 
proposed  as  the  new  Navy  JO  school  selector,  predicts  performance  in  JO  school 
better  than  the  currently  used  CLER  composite. 

The  EDT  appears  to  predict  JO  school  performance  moderately  well:  better 
than  the  CLER  composite  and  about  the  same  at  the  GT  composite.  For  all  three 
school  performance  measures,  the  EDT  substantially  (and  aignificantly)  in¬ 
creases  the  validity  of  the  clerical  and  the  skilled  technical  composites.  It 
does  not,  however,  add  significantly  to  the  validity  of  the  GT  composite  for 
predicting  CLSTAND,  and  it  makes  only  small  additions  to  the  validity  for  pre¬ 
dicting  FSG  and  CLSTAND.  These  latter  increases  in  explained  variance  were 
found  to  be  statistically  significant,  but  they  are  modest  in  magnitude  and  of 
dubious  practical  significance  (the  increases  to  the  multiple  correlation  coef¬ 
ficients  were  about  .04  correlation  points). 

Because  of  the  time  and  expense  that  would  be  associated  with  adding  the 
administration  of  EDT  to  the  Navy  enlisted  classification  procedures,  use  of  the 
EDT  for  classification  purposes  could  only  be  justified  if  very  large  increases 
in  prediction  of  school  success  were  associated  with  it.  The  increases  found  in 
this  study  appear  too  small  to  justify  the  addition  of  the  EDT  to  the  JO  school 
selection  criteria. 

The  regression  analyses  showed  that  for  FSG  and  CLSTAND,  adding  the  El  and 
NO  tests  to  the  GT  composite  significantly  increases  the  validity;  similarly  for 
GRAD/DROP,  adding  the  MC  and  GS  tests  significantly  increases  the  validity. 
However,  when  these  tests  are  combined  with  the  those  that  comprise  the  GT  com¬ 
posite  (VE  and  AR)  to  form  unit -weighted  composites,  and  these  composites  are 
correlated  with  the  criteria,  the  resulting  validity  correlations  are  not  sig¬ 
nificantly  higher  than  those  of  the  GT  composite.  This  result  argues  against 
the  utility  of  adding  these  ASVAB  tests  to  the  GT  selector  composite. 

Because  attrition  is  a  particular  problem  in  the  JO  school,  the  results  of 
the  expectancy  analyses,  which  used  attrition  (GRAD/DROP)  as  the  criterion,  are 
of  special  interest.  These  results  clearly  showed  that  use  of  the  proposed  GT 
composite  would  substantially  reduce  academic  attrition,  from  the  current  rate 
of  23  percent  down  to  11  percent.  They  also  indicated  that,  although  the  aca¬ 
demic  attrition  rate  could  be  lowered  to  12  percent  by  raising  the  cutting  score 
of  the  operational  CLER  composite,  this  approach  would  not  be  feasible  due  to 
the  drastic  reduction  in  potential  school  admissions--from  37  percent  down  to  10 
percent--that  would  result. 


RECOMMENDATIONS 

1.  The  ASVAB  general  technical  composite  (VE  +  AR),  rather  than  the  cur¬ 
rently  used  clerical  composite  (VE  +  NO  +  CS),  should  be  used  to  select  Navy  stu1 
dents  for  Basic  Journalist  (JO)  school. 

2.  The  English  Diagnostic  Test  (EDT)  should  not  be  added  to  the  Navy  JO 
school  selection  criteria. 


Selection  criteria  for  the  Strategic  Weapons  Systems  Elec- 
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/  ThiB  research  evaluated  t^ie  Armed  Services  Vocational  Aptitude  Battery  (ASVAB) 
clerical  composite,  which/  is  used  to  determine  qualification  of  Navy  recruits  for 
Basic  Journalist  (JO)  ^A"'  school .  The  research  also  evaluated  the  contribution  of 
the  English  Diagnostic  Test  (EDT)  to  the  ASVAB  selection  criteria.  Correlational 
and  expectancy  analyses  indicated  that  the  ASVAB  general  technical  composite  predicts 
performance  in  JO  school  better  than  does  the  clerical  composite.  The  EDT  makes  a 
small  but  significant  contribution  to  the  validity  of  the  ASVAB  general  technical 
composite.  V 
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